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ABSTRACT 

Northampton County Area Community College 
(Pennsylvania) studied changes in student writing ability using a 
research paradigm described in the ERIC Clearinghouse for Junior 
Colleges* fifth topical paper (ED 030 422). Students in seven English 
classes were randomly assigned to write on one of two topics at the 
beginning of the semester, and asked to write on the other topic at 
the end of the semester. Evaluation proceeded by mixing pre- and 
post-writing samples, and then distributing them for grading, in 
accordance with a 22-item rating sheet. Samples were identified by a 
student code number that did not indicate whether they were pre- or 
post-writing samples. The ««t M ratio for related sample means was used 
to investigate any significant differences between mean scores, and 
writing strengths and weaknesses for pre- and post-writing samples 
were compared. Also, 4Q of the P7 students studied did not provide a 
post-writing sample because of withdrawal or other absence. Their 
writing strengths and weaknesses were compared with those who took 
both the pre- and post-tests. Finally, the students who did improve 
their scores were compared with those who did not. While the research 
procedures and scoring system indicate that the students as a group 
did not learn to write better, such factors as student absences, 
motivation, and measuring instrument validity will be further 
investigated through a replication of the study. (JO) 
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Is Anyone Learning to Write at NCACC? 



In an attempt to answer this question objectively the College’s English 
Department set up a research study whose design was recommended by the ERIC 
Clearinghouse for Junior College Information.* 



During the first weeks of the spring semester the students in seven En- 
glish II classes were given at random either topic S or topic W on which to 
write. 



Topic S: 



"You can tell the character of every man when you 
see how he receives praise.” 



Seneca (h B.C. - 6$ A.D. ) Epistles 



Topic W: 



"Children begin by loving their parents 5 as they grow 
older they judge them; sometimes they forgive them.” 



Oscar Wilde , The Picture of Dorian Gray 



The student’ s identification was coded by the coordinator of the research 
project. At the end of the semester the students were again asked to write on 

a topic. If they had written on topic W earlier they now wrote on topic S, 

and vice versa. Again student identification was coded. The coordinator then 
mixed the pre-writing samples and post-writing samples and distributed them to 

the instructors to be graded. The instructors did not know who had written the 

papers or whether or not they were the pre or post writing samples. 



During the semester the instructors developed a scoring sheet based on the 
one recommended by ERIC. It consisted of 22 rating areas and each area was 
rated "1" or "0”. A perfect score would have a score of 22. During the crea- 
tion of this scoring procedure it is assumed that the instructors came to agree- 
ment on not only what areas were to be rated but also to agreement when a paper 
had or had not this rating. (The scoring sheet can be found attached.) 



The papers were scored and returned to the coordinator. Pre and post 
writing total scores were then tabulated as well as item scores. The statis- 
tical evaluation is based on 8 ? pairs of writing samples. An analysis will 
also be done on the pre-writing samples of the h$ students that either dropped- 
out of College, withdrew from the Blnglish class, or were not in class on that 
day. 



The first and major question that is to be answered is whether or not 
there is a gain in scores from pre-to-post and if this gain is significant. 

The method of analysis is the t ratio for related sample means. The t value 
is 0 . 14 2 8 and hence there is no significant difference between the mean scores. 
Hence it is therefore concluded, based upon the scoring system and the research 
procedures, that these students, as a group, did not learn how to write. 



^ Ts Anyone Learning to Write? , ERIC Clearinghouse for Junior College Informa- 
tion, University of California, Los Angeles, California, February, 1969 . 
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The following tables shows the means, standard deviations, and ranges • 

of the pre-and-post-writing samples* ] 

Table I Pre-and-Post-Writing Samples Group Data N ■ 8? : 

Mean 5* D* Range , 

Pre-Writing Samples ll«5>ii ii*33 U — 21 

Post-Writing Samples 11*78 ii*9 8 2 -22 

The second area of concern is the values of the pre-and-post scores the 
group received with respect to each scoring area* j 



Table II Scoring Area Totals and Percentages 





Pre-Writing Sample 


Post 


-Writing Sample 


Area 


Total Score (N 


- 87) 


Total Score 


(N< 


■ 87) 




N 




N 






z 


1 


26 


30 


27 






31 


2 


6 


7 


12 






lii 


3 


S8 


67 


S3 






6l 


ii 


3S 


iiO 


iiO 






U6 


S 


61i 


7ii 


61i 






7ii 


6 


U3 


1x9 


iil 






ii7 


7 


22 


2S 


2ii 






28 


8 


li8 


SS 


U8 






SS 


9 


ii k 


Si 


h2 






ii8 


10 


26 


30 


32 






37 


11 


S2 


60 


S8 






67 


12 


60 


70 


S9 






68 


13 


ii3 


U9 


36 






iil 


Hi 


68 


78 


67 






77 


IS 


SS 


63 


SU 






62 


16 


U8 


SS 


S9 






68 


17 


ii6 


S3 


37 






U3 


18 


6U 


7ii 


63 






72 


19 


68 


78 


6U 






7ii 


20 


3S 


iiO 


1x3 






ii9 


21 


2ii 


28 


33 






38 


22 


70 


80 


71 






82 


In 


analyzing the above 


table one can 


see that there 


is very 


little 


difference between the pre-< 


and-post-scores 


for each area. 


However, 


the pur 



pose of the table is to enable one to describe the areas of strengths and 
1 weaknesses in writing of this group* It must be remembered that the group 
had total mean percentage scores of £2 and respectively. For scoring 
area 1, for example, 26 out of the 8? students scored l*s on the pre-writing 
sample* 
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The writing strengths, in descending order, of the group on the pre- 
writing samples are: 



Table III 



Area 



Pre -Writing Sample Strengths 
Name of Area 



% 



22 

19 

IU 

18 

12 

3 



There is variety in sentence structure 

There are not errors in use of modifiers 

Punctuation errors are not excessive 

There is not faulty parallellism 

There is a thesis 

There are not many misspellings 

Ideas are rational or logical 



80 

78 

78 

7h 

7h 

70 

67 



The writing weaknesses, in ascending order, of the group on the pre- 
writing samples are: 



Table IV 



Area 



Pre-Writing Sample Weaknesses 
Name of Area 



% 



2 

7 

21 

T 

ib 



Ideas are creative or original 
Thesis is adequately developed 
The sentences are awkward 
Ideas themselves are insightful 
Each paragraph is developed with relevant and 
concrete details 

Ideas are expressed with clarity 



7 

25> 

28 

30 



30 

h0 



The writing strengths, in descending order, of the group on the post- 
writing samples are: 



Table V 



Area 



Post-Writing Sample Strengths 
Name of Area 



% 



22 

lh 

18 

19 

12 

16 

11 



There is variety in sentence structure 

Punctuation errors are not excessive 

There is a thesis 

There is not faulty parallelism 

There are not errors in the use of modifiers 

There are not many misspellings 

There are not errors in the use of apostrophes 

The details that are included are well ordered 



82 

77 

lh 

72 

71* 

68 

68 

67 



The writing weaknesses, in ascending order, of the group on the post- 
writing samples are: 
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Table VI 



Area 



Post-Writing Sample Weaknesses 
Name of Area % 



2 

7 

1 

10 



21 



Ideas are creative or original 
Thesis is adequately developed 
Ideas themselves are insightful 
Each paragraph is developed with relevant and 
concrete details 
The sentences are awkward 



1U 

28 

31 



37 

38 



The areas of the strengths and weaknesses of both pre-and-post- 
writing samples are practically identical. The three areas that show the 
most increase, and this need not be improvement but rather regression 
towards the mean, are areas 16, 21, and 20. 



Table VII 



Area 



Area Increases in Pre-and-Post-Writing Samples 

Name of Area % Increase 



16 

21 

20 



There are not errors in use of apostrophes 
The sentences are not awkward 
There are not distracting errors 



13 

10 

9 



It must be pointed out again that as a group there was no significant 
improvement in writing. 



The areas in which the achievement decreased were: 



Table VIII Area Decreases in Pre-and-Post-Writing Samples 
Area Name of Area % Decrease 



17 

13 

3 



There are errors in use of pronouns 
There are serious punctuation errors 
Ideas are rational or logical 



10 

8 

6 



Although most of the group scored between 7 and 16 on the pre-writing 
sample (representing a percentage grade, if the areas are equivalent, of 
32 to 73 respectively), it should be valuable to investigate the pre-writing 
sample scores of those h9 students that withdrew from the class, or withdrew 
from the College, or that simply were absent for the post-writing sample. 



Table IX 



Group Data on Students With Pre-Writing 
S ample Only N "■ U9 



Mean 



S. D. 



10.61 



3.61 



Range 
2 -21 
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There is a difference in mean scores between the pre-post group and this 
group but the difference is not significant (z * 1.31*7). Compare with Table I. 



Although the mean scores are not significantly different it may be that 
an analysis of the item scores will show differences. 

Table X Area Scores of Pre-Writing Sample Group N » 1*9 



Area N % 



1 


13 


27 


2 


1* 


8 


3 


26 


53 


1* 


18 


37 


5 


36 


73 


6 


20 


1*1 


7 


5 


10 


8 


21* 


h9 


9 


21* 


h9 


10 


13 


21 


11 


23 


hi 



Area 


N 

mm:* 


% 


12 


28 


57 


13 


2h 


h9 


lh 


33 


67 


15 


26 


53 


16 


21 


55 


17 


25 


51 


18 


35 


71 


19 


ho 


82 


20 


19 


39 


21 


17 


35 


22 


1*1 


81* 



The writing strengths, in descending order, of the group with just pre- 
writing sample scores are: 



Table XI Pre-Writing Sample Strengths - Pre-Group 

Area Name of Area 

22 There is variety in sentence structure 

^9 There are not errors in use of modifiers 

5 There is a thesis 

1® There is not faulty parallelism 

lii Punctuation errors are not excessive 



% 

8 1 * 
82 
73 
71 
67 



This table compares equivalently to that of the pre-writing sample 
strenghts of the pre-post group. Compare with Table III. The writing weak- 
nesses, in ascending order, of the group with just pre-writing sample scores are 



Table XII Pre-Writing Sample Weaknesses - Pre-Group 



Area 



Name of Area 



% 



2 

1 

10 

1 

21 

h 

20 



Ideas are creative or original 8 

Thesis is adequately developed 10 

Each paragraph is developed with relevant and con- 
crete details 27 

Ideas themselves are insightful 27 

The sentences are awkward 35 

Ideas are expressed with clarity 37 

There are distracting errors in word usage 39 



Again this table compares remarkably equivalent to that of the weaknesses 
of the pre-post group. Compare with Table IV. The hope was, in this part of the 
investigation, to discover a difference between the groups. However there was none. 
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The next area of concern is to investigate whether or not there are 
any differences between the group of students that did improve their scores and 
the group that did not* The following table describes this group that showed 
an improvement* 




Table XIII Improvement-in-Writing -Scores Group (N = Mi) 



Pre-Post Scores Sex G* S* 



ACT English ACT Soc, Sci, Final 6rade 



7-9 


M 


Y 


10 


8-15 


M 


Y 


11 


6-16 


M 


Y 


16 


18-22 


F 


N 




16-20 


F 


N 




10-1U 


F 


N 


— — 


8-9 


M 


Y 


lh 


11-12 


M 


N 


•»_ 


12-22 


F 


N 


mmtm 


10-11 


M 


N 




6-8 


M 


N 


17 


7-12 


M 


N 


— — 


11-12 


M 


N 




5-16 


F 


N 


nn 


12-18 


F 


N 




11-18 


F 


N 




lh-15 


M 


Y 


lh 


3-20 


M 


N 


23 


11-13 


M 


N 


16 


9-13 


F 


Y 


18 


6-12 


M 


N 




15-19 


F 


N 




11-13 


M 


N 


__ 


16-21 


F 


N 


19 


10-19 


M 


N 


— 


17-22 


F 


N 


... 


11-12 


M 


N 


19 


13-15 


F 


N 


22 


13-18 


M 


Y 


15 


13-15 


M 


N 


— 


6-10 


M 


Y 


lh 


13-17 


M 


Y 


17 


10-16 


M 


N 


20 


10-18 


M 


N 


20 


6-17 


M 


Y 


10 


3-6 


M 


Y 


09 


5-6 


M 


N 


.. 


k-9 


M 


Y 


13 


7-12 


M 


Y 


10 


15-16 


M 


N 


18 


11-16 


F 


Y 


lli 


6-9 


M 


Y 


09 


7-11 


M 


Y 


19 


8-9 


F 


Y 


16 



2k 

17 

21 



21 



03 



16 

25 

20 

13 



21 



OU 

28 

lh 



12 

15 
17 
27 
13 
11 

23 

12 

25 

lh 

lh 

23 

16 



B 

C 

B 

C 

B 

D 

B 

B 

C 

C 

B 



B 

C 

B 

B 

W 

B 

G 

C 

A 

A 

B 

A 

B 

C 

B 



i 

I 






B 

C 

c 

D 

C 

C 

B 

C 

F 



<■ 



i 



C 

c 

C 

B 

C 

B 

D 

C 



i 
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Table XIV Group With No Improvement in Writing Scores (N ■ lt3) 




Pre-Post Scores 

lli-ll 

12-11 

11-8 

8- 3 

9- 6 

11- li 
10-6 
19-10 

12- 7 
lii-7 

19- 19 
16-15 
17-10 

20 - 16 

8-7 

12-12 
11-10 
12-11 
U-3 

8- 7 

9- 9 
7-7 

10-10 
10-8 
9-9 

11— 5 

18- 9 
7-7 

19- 18 

13- 5 
19-9 

ia-u 
16-10 
10-6 
ia-6 
17-10 
16-15 

12- 9 
10-10 
15-3 

19- 19 

21-12 

20 - 12 



Sex G * s « ACT English ACT Soc. Sci. Final Grade 



M 

M 

M 

M 

M 

M 

M 

M 

M 

M 

F 

F 

M 

M 

M 

F 

M 

M 

M 

F 

M 

M 

M 

F 

F 

M 

M 

M 

F 

M 

M 

M 

M 

M 

M 

M 

M 

M 

M 

M 

M 

F 

F 



Y 

Y 
N 

Y 

Y 

Y 
N 

Y 
N 
N 
N 
N 
N 
N 
N 
N 

Y 

Y 

Y 
N 

Y 
N 
N 
N 
N 
N 
N 

Y 
N 
N 

Y 

Y 

Y 

Y 
N 
N 
N 

Y 

Y 

Y 
N 
N 
N 



08 

ia 

13 

10 

11 
17 

12 
23 



13 



18 

08 

10 

12 

18 

16 



05 

03 

25 

20 

15 

12 

11 

15 

ia 

11 

03 

10 

2a 



09 

ia 

sw 

11 

19 

15 

10 
13 
22 



20 



18 

17 

11 

ia 

12 

12 



02 

01 

2a 

2a 

10 

27 

07 

06 

ia 

07 

15 

18 

32 



C 

C 

C 

F 

D 

D 

D 

C 

C 

B 

B 

D 

B 

B 

B 

C 

F 

D 

D 

D 

D 

B 

C 

C 

A 

A 

A 

B 

A 

C 

C 

B 

D 

D 

B 

B 

B 

B 

B 

C 

B 

I 

A 
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Because of missing ACT scores it is impossible to compare the two groups 
m this aspect, A summary of Tables nil and XIV leads to the following 
description of the two groups: 



Table XV Improvement-in-Writin^ Scores Group (N ■ IUj,) 

vs. Group with No Improvement in Writing Scores (N = li3) 



Improve Group No Improve Group 



Number of males 
Number of females 
Number with G. S, Writing 
Mean Final Grade in Course 



30 


35 


lh 


9 


16 


18 


2.37 


2.21+ 



It is obvious from the table above that there are no real differences 
between the groups other than the groups themselves. 



The last area that concerned this researcher was the actual make-up of 
the group of students that had written the pre-writing sample. With 
help from the records office it was determined that of these h9 students, 

21 had in fact withdrawn from the course while the remaining 28 simply were 
absent from class that day. 



Conclusions 



1, With the assumption of reliability of research design and validity and 

reliability of the measuring instrument, the students did not learn how 
to write. 



2. There are no definable factors which differentiate the students that showed 
improvement with those that did not. 



Implications and Speculations : 

1, That the students were not taught how to write, 

2, That the students did not learn how to write. 

3, That the measuring instrument is invalid. 

lw That the scores were not consistent. 

5* The research procedures, i.e. the students spending a period to write 
an essay and never getting it back, did little to motivate the students 
to perform at his highest level the second time around, 

6. The lack of control, i.e., the 28 students that did not take the post- 
writing sample, affected the results. 
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Recommendations : 

1. After study and evaluation by the English department the study be replicated 
with a revised scoring procedure and better control. 

2. That this study be interpreted as a pilot study and that through analysis 
and evaluation of it, that additional testable hypotheses be generated 
for use in the second study* 



SCORE SHEET 



YES 

Content I. 



Organisation II. 



Mechanics III. 



» 1 * We as themselves are insightful. 

_ 2. Ideas are creative or original. 

. 3 * Ideas are rational or logical. 

„ Ideas are expressed with clarity. 

_ 5. There is a thesis. 

The thesis idea is developed in a logical order. 

. 7 * Thesis is adequately developed* 

. 8 * Every paragraph is relevant to the thesis. 

. 9 * Eac h paragraph has a controlling idea. 

. Each paragraph is developed with relevant and 
concrete details. 

. ^he details that are included are well ordered. 

12. There are many misspellings. 

13. There are serious punctuation errors. 

14. Punctuation errors are excessive. 

15. There are errors in use of verbs. 

16. There are errors in use of apostrophes. 

17. There are errors in use of pronouns. 

18. There is faulty paraliellism. 

19. There are errors in use of modifiers. 

20. There are distracting errors in word usage. 

21. The sentences are awkward. 

22. There is variety in sentence structure. 

CODE NO. 
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